Adaptive Framework for Multivariate Stream Data Processing in Data-Centric Sensor Applications
نویسندگان
چکیده
We introduce an adaptive framework for multivariate sensor stream data reduction. The proposed method takes as input a sliding window of multivariate stream data, classifies the data in each window, and chooses reduction strategies that are most appropriate for the window. In the classification step, it discretizes the stream data into a string of symbols that characterize the signal changes and then applies classification algorithms to classify the transformed sensor stream data. In the second step, depending on the classification labels assigned to each window, it applies most appropriate data reduction techniques and reduction ratios to the window. For classification, we considered supervised methods including Naïve Bayes Model and SVM, and unsupervised methods including Jaccard, TFIDF, Jaro and JaroWinkler. For data reduction, we compared Wavelet, Sampling, SVD and Hierarchical clustering. In our experiments, SVM and TFIDF outperformed the other classification methods and SVD and Sampling showed the best result in data reduction.
منابع مشابه
UpStream: Storage-centric Load Management for Data Stream Processing Systems
Processing fast updating data streams in real-time must reflect the most recent data. A number of technologies including Data Stream Management Systems have emerged to respond to this challenge. While running their queries in a continuous fashion on high-volume push-based data streams (e.g. sensor data, GPS coordinates, stock quotes), one of the most important optimization problems that these s...
متن کاملPilot-Streaming: A Stream Processing Framework for High-Performance Computing
An increasing number of scientific applications rely on stream processing for generating timely insights from data feeds of scientific instruments, simulations, and Internet-of-Thing (IoT) sensors. The development of streaming applications is a complex task and requires the integration of heterogeneous, distributed infrastructure, frameworks, middleware and application components. Different app...
متن کاملEvolutionary Computing Assisted Wireless Sensor Network Mining for QoS-Centric and Energy-efficient Routing Protocol
The exponential rise in wireless communication demands and allied applications have revitalized academia-industries to develop more efficient routing protocols. Wireless Sensor Network (WSN) being battery operated network, it often undergoes node death-causing pre-ma...
متن کاملA Self-Adaptive Regression-Based Multivariate Data Compression Scheme with Error Bound in Wireless Sensor Networks
Wireless sensor networks (WSNs) have limited energy and transmission capacity, so data compression techniques have extensive applications. A sensor node with multiple sensing units is called a multimodal or multivariate node. For multivariate stream on a sensor node, some data streams are elected as the base functions according to the correlation coefficient matrix, and the other streams from t...
متن کاملData Centric Sensor Stream Reduction for Real-Time Applications in Wireless Sensor Networks
This work presents a data-centric strategy to meet deadlines in soft real-time applications in wireless sensor networks. This strategy considers three main aspects: (i) The design of real-time application to obtain the minimum deadlines; (ii) An analytic model to estimate the ideal sample size used by data-reduction algorithms; and (iii) Two data-centric stream-based sampling algorithms to perf...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2005